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Abstract 

We consider a multi-particle generalization of linear edge-reinforced random walk 
(ERRW). We observe that in absence of exchangeability, new techniques are needed 
in order to study the multi-particle model. We describe an unusual coupling construc- 
tion associated with the two-point edge-reinforced process on Z and prove a form of 
recurrence: the two particles meet infinitely often a.s. 



1 Introduction 

The edge- reinforced random walk was first introduced in [2] and [5]. In this paper we will 
study linear multi-particle edge-reinforced processes on Z. In the original edge-reinforced 
random walk model, each edge of a locally finite non-directed graph is initially assigned 
weight a > 0. With each step, the particle jumps to a nearest-neighbor vertex. The proba- 
bility of the jump equals to the fraction of the weight attached to the traversed edge in the 
total sum of the weights of the edges coming out of the vertex where the particle is located 
prior to the jump. Each time an edge is traversed, its weight is increased by 1. In other 
words, the linear edge-reinforced random walk is a random walk on a weighted graph, where 
the weight of an edge is increased by one each time it is being traversed. 

One of the most important open problems in the theory of reinforced random walks is 
that of checking if the linear edge- reinforced random walk is recurrent on Z d for dimensions 
d > 2. Linear edge-reinforced random walk is exchangeable making the model an important 
example for applying the theorem of de Finetti (see [7]) and its generalizations (see jl], [5]). 
The history and some of the most important results in reinforced processes can be found in 
0, [3], pig, [H], PQ, [32], pi] and references therein. 
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In this paper we will consider a multi-particle modification of the edge-reinforced random 
walk model similar to some of the reinforced processes studied in [IT]. We let the walker 
(or particle) in the edge-reinforced random walk model wait an independent exponential 
time with rate one between the jumps. So, the walker jumps from a site to a near by site 
with rates equal to the corresponding ratios. Now we are ready to define an n-point process 
r)t = {r)i(t), . . . , r) n (t)}, where all n particles travel along the edges of a graph G, jumping from 
a site to a neighboring site in 5", the set of all sites. Now, let W t {e\), W t (ek) be the weights 
assigned to all k edges ei, coming out of a given site v G S at time t. Once again, the 
initial weights are all assigned to be equal to a > 0, i.e. H^o(ei) = Wq^) = • • • = Wo(ek) = a. 
If one of the particles, say rjj, is at site v at t when its exponential clock rings, then the particle 
traverses (1 < % < k) with the rate = Wt ^^"^^ 7^3 ■ In which case the corresponding 
edge weight increases by 1, i.e. W t (ei) = W t -(ei) + 1. The recurrence/transience questions 
arising in this more general model are as important as the corresponding questions in the 
theory of one-article edge-reinforced random walks. 

The edge-reinforced process on Z with drift A > can be defined in the following way: 
if a particle is at site v G Z at the jump time t, then the probability of the particle jumping 
to v + 1 is 

W t -(v,v + l) + A 
W t - (v -l,v) + W t J{v, v + 1) + A 
while the probability of it jumping to v — 1 is 

W t -(v-l,v) 

W t „ (v - 1, v) + Wt-(v, v + 1) + A' 

On trees, the edge-reinforced process with a toward-the-root drift A > can be stated 
accordingly. 

We will concentrate on the most basic case of multi-particle reinforced processes: the 
two point reinforced process rjt = {r]x(t), 772^)} 011 ^ with drift A > 0. We will describe an 
unusual coupling construction associated with the process and as a consequence prove the 
recurrence of (772 (£) — Vi{t)) whenever < A < 1. In the case of a two-particle process on 
Z, one of the two particles is located to the left of another, except for the times when both 
particles are at the same site. We will denote by l t the location of the left particle, and by 
r t the location of the right particle at time t. When r t = h there is no need to distinguish 
between the "left" and the "right" particles. The difference becomes apparent only when 
one of the particles leaves the site. So, r] t = {h, r t }, and here is the main result of this paper: 

Theorem 1. For all < A < 1 and a > 0, (r t — l t ) is recurrent. 

Let us begin by reviewing the Polya's urn model. The urn initially contains Rq marbles 
of red color, land B marbles of blue color. We fix a positive integer number D. A marble is 
randomly and uniformly drawn from the urn, returned, and D marbles of the same color are 
added. Let R n and B n be respectively the number of red and blue marbles in the urn after n 
drawings, and let p n = n ^V. be the fraction of the red marbles in the urn after n drawings. 
It is easy to show that p n is a martingale, and therefore, by martingale convergence theorem, 
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converges to a random variable. That random variable p^ is in turn shown to be a beta 
random variable with parameters ^ and jj, i.e. one with beta density function 

X o (1 — X) o \ (1) 



where (3(a,b) = r{a)r(l) ■ ® ne can cri eck that the urn model is exchangeable (see [7j), that is 
if one permutes the results of m consecutive drawings, the probability of the outcome does 
not change. By de Finetti's theorem, conditioned on p^, the results of the drawings are 
independent Bernoulli trials, where each time a red marble is selected with probability p^ 
and a blue marble is selected with probability 1 — p^. 

The model trivially extends to the case when Rq, B and D are positive real numbers, as 
well as when there are more than two different types of marbles. For instance, consider the 
case when there are three types of marbles, red, blue and green, in the urn. If we start with 
the amounts Ro, B and Go of respectively red, blue and green marbles, then the limiting 
fractions vector will be a Dirichlet distributed random vector, i.e. the cumulative density 
function for the limiting fractions of red and blue marbles will be 

T , Ro+Bo+G \ 

f(x,y) = - /ff ' ,R n \',a n \ XD y D ( 1 ~ x -y) D if z > 0,y > andz + y < 1, 



r(f)r(f)r(t 



where the above density is derived by applying (pQ) twice. 

See [7] for basic facts on exchangeability, the Polya's urn model and a simple version of 
de Finetti's theorem. A simple proof of the convergence to beta distribution can be found 
in [IS]. 

Polya's urns were used to study linear edge- reinforced random walks (see [12])- There, if 
the walk lives on an acyclic graph, say Z, we can assign a Polya's urn for each site. When 
the walker is at site v, we do a drawing from the urn associated with v, where the number 
of the red (respectively blue) marbles in the urn is equal to the weight attached to the edge 
[v — l,v] (respectively [v,v + 1]) at the time. If a red marble is drawn, the walker jumps 
to v — 1 and we add D = 2 red marbles to the urn associated with v. Similarly, if a blue 
marble is drawn, the walker jumps to v + 1 and we add D = 2 blue marbles. We do so 
because the graph is acyclic: if the particle ever returns to the vertex, it will be from the 
same direction it took when it left the vertex. For example, if the red marble is drawn, the 
walker will traverse the edge [v — 1, v] twice before returning to v, thus increasing the weight 
of the edge exactly by D = 2. The initial conditions [R Q (v) , B (v)} at an urn associated 
with site v should be set equal to the weights attached to the edges [v — l,v] and [v,v + 1] 
respectively at the time of the first arrival to v. As an example, consider the edge-reinforced 
random walk on Z that begins at site 0. There the correct initial conditions for a Polya's 
urn assigned to site v G Z should be set equal to 

[a, a + 1] if v < 0, 
[Ro(v),B (v)] = {[a,a] if v = 0, 

[a + 1, a] if v > 0. 
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What follows is that one can do an infinite number of drawings independently for each of 
the Polya's urns associated with the vertices of an acyclic graph before the walk begins, 
thus completely predetermining the trajectory of the walker. Now, the exchangeability 
property of Polya's urns and de Finetti's theorem mentioned above allows one to restate the 
edge-reinforced random walk as a random walk in random environment (RWRE), where the 
environment is distributed as the limiting beta random variables obtained for Polya's urn 
processes associated with each vertex of the acyclic graph. After that, the large deviation and 
other techniques are of use in answering the corresponding recurrence/transience questions 
for the RWRE model (see [12]). 

Does the same approach work for the two point process rjt = {h,^t} on Z? The answer 
is "no". Consider the case when the drift A = 0. Suppose there is an urn at each vertex 
of Z. Suppose a vertex v is visited by the right particle r t , and the drawing was done from 
the urn associated with v and a blue marble was selected, so that the right particle r t jumps 
to v + 1. We cannot add D = 2 blue marbles into the urn, as it could happen that the 
left particle It arrives to the urn from (— oo,v — 1] before the right particle r t returns to v 
from [v + 1, oo). In the latter case, there will be more blue marbles than the weight amount 
attached to the edge [v, v + 1] on the right and the rates will not agree. In other words, the 
representation with Polya's urns and similar approaches will not work because the two-point 
linear edge-reinforced process is nonexchangeable. The non-exchangeability of the process 
was the main obstacle for studying it as well as for proving Theorem [TJ 

2 The Polya's urn modified 

Although the representation with classical Polya's urns fails for the two-point process rjt = 
{l t ,r t }, there is a way to modify it. Suppose that at each vertex of Z, the associated urn 
contains not only the red and blue marbles, but also a special marble, called magic marble, 
such that when the left particle l t arrives to the site, the magic marble becomes red, while 
when the right particle r t arrives to the site, the magic marble becomes blue. Each urn will 
contain exactly one magic marble in addition to red and blue marbles. When magic marble 
is selected, two marbles of the color assumed by the magic marble will be added into the urn. 
Once again the particles move according to the colors of marbles selected from the urns. In 
other words, if the magic marble is selected when it is red, two more red marbles will be 
added to the urn and the particle will jump left. Similarly, if the magic marble is selected 
when it is blue, two more blue marbles will be added to the urn and the particle will jump 
right. 

Let Rt{v) and B t (v) denote respectively the number of red and the number of blue 
marbles inside an urn associated with site v 6 Z, at time t. The initial number of red 
and blue marbles, Ro(v) and B (v), together with the magic marble must represent the 
corresponding weights assigned to edges [v — 1, v] and [v, v + 1] at the time of the first arrival 
to v by any of the two particles. The left particle is the first to visit the sites to the left of 
/o, i.e. all v < lo, and the right particle is first to visit the sites to the right of tq. Hence, for 
all a > 0, the following must be the initial configuration of red and blue marbles assigned to 



lviuiu-parzicie processes wun remiorcemems 



the urns associated with sites in Z: 



[R (v),B (v)\ = { 



a - 1, 1 + a + A] if v < l , 
a — 1, a + A] if v — lo, 

a, a + A] if l < v < r , (2) 
a, a — 1 + A] if v = r , 
a + 1, a - 1 + A] if r < -y 

plus a magic marble in every urn. Here we allow a — 1 < since there is also a magic marble 
in the urn, which is red when the left particle is at the site, and blue when the right particle 
is at the site. 

We now explain the reason why the magic marble was introduced. First we check that 
the above urn representation produces correct rates up until the first recurrence time T\ : = 
min{t : l t = r t }. We consider the case when the right particle departs from site v at jump 
time t < T\. Suppose that the next arrival to v happens before t±, then there are three 
possible scenarios. 

Case I: the right particle jumps to the left, and returns to v before the left particle arrives. 
So 7v — v, r t — v — 1, l t < v, and we need to add two red marbles into the urn, i.e. 
Rt(v) = Rt-(v) + 2. The magic marble stays blue, and as it was the case with one particle 
ERRW model, the rates agree. 

Case II: the right particle jumps to the right, but returns to v before the left particle 
arrives. That is r t _ — v, r t — v + 1, l t < v and we need to add two blue marbles into the 
urn, i.e. B t (v) = B t _(v) + 2. The rates agree since the right particle returns to v before the 
next visit to v by the left particle. Again, the magic marble stays blue, and as it was the 
case with one particle ERRW model, the rates agree. 

Case III: the right particle jumps to the right, and the left particle arrives to v before the 
right particle returns from [v + 1, +oo). This is the case where the chameleon property of 
the magic marble is used. Once again r t _ = v, r t — v + 1, l t < v and we need to add two 
blue marbles into the urn, i.e. B t (v) = B t -(v) + 2. Before the departure of the right particle 
from site v at time t, 

the weight assigned to [v — was = Rt-(v) 

and 

the weight assigned to [v,v + 1] was = B t -(v) + 1 

as the magic marble was blue in the presence of the right particle. When the left particle 
jumps to v from v — 1 at time t\ G (t, Ti) before the return of the right particle, the magic 
marble re-colors into red, and 

the weight assigned to [v — 1, v] = (v ) + 1 = Rt-(v) + 1 

and 

the weight assigned to [v,v + 1] = B tl (y) = B t (v) = B t _{v) + 2. 

One can see that the weights are correct since each edge [v — 1, v] and [v, v + 1] was traversed 
exactly once. 
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That explains why adding magic marble works. The case when the left particle is at site 
v can be checked by the analogy with the case above. 

Observe that the above coupling of the urn process with r\ t works only up until time 
7~i = min{t : l t = r t }, the first time that the particles meet. Now, we need to show that the 
particles meet at least once. Therefore before proving Theorem (TJ we will need to prove the 
following one-time recurrence result: 

Theorem 2. For all < A < 1 and all a > 0, T\ < oo. 

Since the above urn process is coupled with the above described urn process until the 
decoupling time r 1; it suffices to prove Theorem [5] for the urn process. Later it will be shown 
that the construction will also imply the full recurrence, i.e. Theorem [H 



3 Recurrence via coupling. 

The urn construction construction defined in the preceding section determines rj t = (h,rt) 
for < t < T\. Here we let q\{v ) and p[{v) be respectively the left and the right jump rates 
for the left particle at site v. We also denote by q\{v ) and p r t {y) respectively the left and the 
right jump rates for the right particle at site v. By construction, 



and similarly, 



Rt{v) + B t (v) + 1 yn ' R t (v) + B t (v) + V 



It ( v ) = t~> / \ i p 7 x I 1 and Pt ( v ) 



RAv) + BAv) + 1 rt w RAv) + BAv) + 1 



We recall that in the case of edge-reinforced random walks on Z, the urn drawings 
predetermined the outcome of the whole process. There the results of all drawings from the 
urns associated with all the vertices of the graph determined uniquely the trajectory of the 
walker. In the one-particle case one determines the limiting fractions of blue marbles for 
all sites in the form of respective independent beta random variables. Then one interprets 
the walk as a birth and death chain with these rates. We want to implement a similar trick 
for the two-point edge-reinforced process. We will embed the urn process defined in the 
preceding section into a three-color Polya's urn process. 



3.1 Magic family 

For each site v and the urn associated with v, we define the magic family as all the marbles 
that were added as the result of selecting the magic marble, plus the magic marble itself. 
Here is how the magic family is constructed: at the beginning the magic family consists of 
only the magic marble itself. When the magic marble is selected from the urn for the first 
time, and two marbles (of one of the two colors) are added to the urn, we include the two 
into the magic family. Each time a marble from the magic family is selected and two new 
marbles are added, we let the two marbles into the magic family regardless of their color. 
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All the red marbles that are not in the magic family will be called pure red, and all the 
blue marbles that are not in the magic family will be called pure blue. Observe that for 
each site v, the urn associated with v is a Polya's urn with respect to three types of marbles: 
pure red, pure blue and the marbles in the magic family. Each time when a pure red marble 
is selected, two more pure red marbles are added to the urn. Same is true for pure blue 
marbles. 

For each site v, we let R n (v), B n {y) and M n {v) denote respectively the number of pure 
red marbles, the number of pure blue marbles and the number of marbles in the magic family 
inside the urn associated with site v after n drawings. The proportion vector of pure red 
marbles, marbles in the magic family and pure blue marbles 



Rniv), M n (v), B n (v) /{Rn{v) + M n {v) + B n {v)) 



converges to a Dirichlet random vector with parameters , | and 



Bq(v) 



We observe that after n drawings, M n {v) — 1 marbles in the magic family are of either 
red or blue color. Therefore R n (v) < R n {y) and B n {v) < B n {y). Let B(a,/3) denote the 
beta distribution with parameters a > and (3 > 0. If for each v we define p l Po i ya (v) as the 
limiting fraction of pure blue marbles, then p l p i ya {v) will be a beta random variable with 



parameters 



Bq(v) 



and 



Looking back at ([2]), one can write down the corresponding 



B (^P-, *°M±i) distribution of p l Polya (v) for each v € Z. For a < 1 - A, 



PPolyaKV) IS < 



fB(a±ifc4 a) if v </ , 
fi(^,§) if v = l , 



B(^, 2 ^) ifl <v<r , 
,0 if r < v 



and for a > 1 — A, 



PPolya 



a+l+A ifv<: /( . 

a+A a\ 
2 ' 2 



f) ifu = i , 



V) IS < 



B{ 

B(^,2±l) if/ <^<r , 
ifv = r , 



a-l+A 



2 -, 1 + f ) if r < u. 

Similarly, qp i ya {v) defined as the limiting fraction of pure red marbles in the urn will be a 
beta random variable with parameters Ro ^ and B °^ +1 . So for a < 1, 



'0 if v < Z , 

B(f,^^) if/ <^<r , 
if v 



2 5 2 y ■ LJ - L ' ^"o? 

Ii3(^±i,^) ifr <t;. 
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and for a > 1, 

"B(2fi,l + s±^) ift;</ , 

B( o f l )2 ±l±A ) if , ; = Zo; 

fi(|,4±A) if« = r , 
^(s±l,2±4) if r < u. 

Let ^Polya ■= 1 -Ppolya aIld Ppoij/a : = 1 ~ Ipolya' TheI1 the P airS Wpolya( V ) , Ppalya( V ))veZ and 

i. ( fpoiya( v )iPpoiya( v ))v& can De viewed as two dependent random environments. We define 
j^Poiya ag a ranc [ om wa }k j n the random environment (qp i ya (v) , p l Polya (v ))„ e z that starts at 
/^°^ a = /o and jumps from v to v + 1 with rate p l Po i ya {v) or to f — 1 with rate q l Po i ya {v). Sim- 
ilarly, we define rf olya as a random walk in the random environment {.qp i ya {v),p T Polya {y )) vG z 
that starts at r^ olya = r and jumps from v to v + 1 with rate p r Po i ya {v) or to u — 1 with rate 

?PoZi/a( t ')- 

We observe that conditioned on the two dependent environments, the two random walks, 
^Poiya anc j r Poiya^ can coexist as two independent birth and death chains. In the next sub- 
section we will couple {lt° lya , rf olya } with {l t , r t } so that 

it olya <k<n< n olya for o < t < n . 

Then showing the recurrence of [r^ olya — l^ olya ) will prove Theorem [21 Here is the heuristic 
explanation for the coupling construction to follow. If in the original urn model {l t ,r t }, we 
substitute the magic marble with a red marble in every urn, then the left particle process It 
will be distributed as the random walk in random environment l^ olya . If in turn we substitute 
the magic marble with a blue marble in every urn, then the right particle process will have 
the same distribution as rf olya . Observe that this heuristics can be generalized to work in 
the case of more than two particles, e.g. three-particle linear edge-reinforced processes on Z. 

3.2 Coupling with RWRE 

We notice that the process {l t , r t } can be predetermined by the results of all drawings from 
the Polya's urns with three types of marbles: pure red, pure blue and magic family. We 
can first do the drawings from the urns associated with all the sites in Z, determining 
[R n (v),Mn(v),B n (v)] n = 0! i }2> ... for all v and the limiting fractions {q Po i ya (v),p l Polya (v)} v& of 
pure red and pure blue marbles. By de Finetti's theorem, conditioned on qp i ya (v) , p l Polya (v ), 
[Rn(v), M n (v), B n (v )] n =o,i,2,... are determined as independent trials with probabilities q Po i ya {y) 
and Pp i ya (v) for pure red and pure blue marbles respectively. When one of the two particles 
visits site v, the results [R n (v), M n (v), B n {y)] of the n-th drawing (if it is the time of n-th 
departure from the site) determine the destination site and the coloring of the marbles in 
the magic family. 

We recall that in the Polya's urn model the limiting fraction of marbles of one color is a 
particular beta random variable and the density function f^ q r p ( (v) >p i p ( [v)}i x i y) f° r the pair 
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of limiting fractions q Po i ya {y) and p Po i ya {y) is Dirichlet 



-p / R (v)+B (v)+1 



r^jr(«jr(i) 

if a; > 0, y > and x + y < 1. 

Now we construct the coupled process {/f olya , l t , r t , r t olya }; 

• We condition on the Dirichlet variables {qp i ya iy),p Polya {v)} ve i- 

• We begin with l Polya = l < r = r^°' ya . 

• The trajectories of It and r t are determined by drawings from the urns. 

• l Polya and r^ olya are independent birth and death chains with corresponding probabil- 
ities {q l Po i ya iv),p l Polya {y)) v& and (gp ^a( w )>Pp / 2/ a( v ))^z that move independently of 
each other and of l t and r t except for the times when \ Polya = \ t or r^ olya = r t . 

• When the left particles / and l Pol y a happen to be at the same site v, they wait for 
the departure time with rate one. Then the results of the next drawing from the 
corresponding urn are studied. If the selected marble is red or magic marble, both 
particles jump to v — 1. However, if the selected marble is blue, the left particle / 
jumps to v + 1, while l Pol y a jumps to v + 1 only if the marble is pure blue, and jumps 
to v — 1 otherwise. The probability that l Pol y a jumps to v + 1 is equal to p l p i ya (v), and 
each such drawing is independent of all the other drawings. l Polya will still be a random 
walk in random environment {qp i ya {v),p l p olya (v)) v< zz, while \ Polya < \ t is preserved. 

• Similarly, when the right particles r and r Polya happen to be at the same site v, they 
wait for the departure time with rate one. Then the results of the next drawing are 
studied. If the selected marble is a blue or a magic marble, both particles jump to v + 1. 
If the marble is red, the right particle r jumps to v — 1, while r Polya jumps to v — 1 only 
if the marble is pure red, and jumps to v + 1 otherwise. The probability that r Polya 
jumps to v — 1 is equal to qp i ya (v), and each drawing is independent of the others. 
r Poiya s till be a random walk in random environment (qp i ya {v) , p r Polya (v)) ve z, while 

Polya • j 

rt < r t is preserved. 
In the above coupled process, conditioned on the environments, the independence of l Polya 

j Polya ■ j j 

and r t y is preserved and 

lt olya <k<n< r P t olya . 
Thus showing the recurrence of [r Polya — l Polya ) is enough to prove Theorem [21 

Recall form the theory of RWREs: a RWRE on Z with the right jump probability p(v) 
chosen to be ^y^) distributed at all sites v is transient to the right whenever < 
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A < 1, explaining the bound on the drift A in Theorem [TJ In general, RWRE on Z is a.s. 
transient to the right if and only if E[\og ( jz^j j] > ( see P3] f° r t ne proof, and [T3] . 
[9] and references therein for more on the subject). Not surprisingly the RWRE with the 
environment {p(v)} v€ z independently £>(ai,a 2 ) distributed with cti > a 2 is a.s. transient to 
the right: 



£[log 



p(v) 



p(v) 



f3(a 1 ,a 2 ) 
4 

23— «i- c*2 



log 



1 — x 



x ai - l (l 



X 



,"2 — 1 



,se 



(1 + e 2 T (Ql+a2) cL< 



/3(ai,a 2 ) 
> 0, 



— oo 
oo 



s smh(( ai -a 2 )s) (cosh s)- (ai+a2) ds 



where we substitute 



l-x 



e . In the above general case, E 



i-p(^) 

p(v) 



I3( ai -l,a2+l) 
/3(ai,a 2 ) 



«l — 1 



if 



ci\ > 1, and 



i-p(") 



+oo if a\ < 1. 

The expected time of return is a.s. finite only when E 
only when ot\ > 1 + a 2 . Now, if one considers a RWRE on Z with independent right jump 

2 ' 



i-pQ) 
p(i>) 



< 1 (see [H]). That is 



probabilities {p(v )}„ez, each £>(^-, ^-^) distributed, the recurrence time is infinite since 

i+l ^ 1 _i_ a+l 
2 2 



4± < 1 + ^ for A > 0. 

The above implies that the expected time of return to site v for r Polya is infinite if 
v < r^ olya and is finite if rf olya < v. Similarly, the expected time of return to site v for l Pol y a 
is infinite if l Polya < y and is finite if v < l^ olya . 



3.3 Proof of Theorem EL 

In this subsection we will prove Theorem [21 



Proof of Theorem® Recall that the environments {(pp i ya (v),q l p olya (v)} v€ z and 
{{p r p i ya (v ), q r Polya (v )} v ei of l Polya a nd r^ olya are dependent, but conditioned on the envi- 
ronments, the walks \ Polya and r^ olya are independently. We claim that, even though the 

, j r , c I Polya jPolya\ , • r> / Polya iPolya\ • , 

expected time of return of [r t — l t ) to zero is infinite, (r t — l t ) is recurrent. 
The problem can be summarized by the following more general lemma. 

Lemma 1. Let pi(l),pi(2), ... be i.i.d. random variables defined on (0,1) with 

'1 -Pii})' 



E 



log 



PiW 



> 0, 



e.g. p\{i) ~ i3(ai,6i) for < ai < &i, and /ei p 2 (l),p 2 (2), 
defined on (0, 1) u>rf/i 

1^2 — E log -— 



6e i.i.d. random variables 



> 0, 
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e.g. p 2 (i) ~ B(a 2 , b 2 ) for < a 2 < b 2 . Also let p x (0) = p 2 (0) = 1. 

7/p 1 (0),pi(l),pi(2), ... are the forward rates for the birth- and- death chain Z\, and 
P2(0),P2(1);P2(2), ... are the forward rates for the birth- and- death chain Z\, then the two 
dimensional RWRE X t = {Z l tl ZD returns to zero infinitely often. 

The following is equivalent statement that we can apply in our case: Suppose Z\ is a 
RWRE on Z + such that for any i > 0, Z\ jumps from site i to i + 1 with rate pi(i) and to 
i — 1 with rate 1 — Pi(i), and suppose Z\ is a RWRE on Z_ such that for any % > 0, Z\ jumps 
from site —i to — (i + 1) with rate ^2(2) and to — (i — 1) with rate 1 —p 2 (i). If conditioned on 
the environments {pi(i)}i and {p 2 (.7)}j> an d ^ are independent birth and death chains, 
then Z T t — Z\ is recurrent. 

The proof of the above lemma can be thought of as an exercise on use of harmonic 
functions in stochastic processes. It can be done with Lyapunov functions (see [§]), or 
alternatively with conductivities. □ 

3.4 Proof of Theorem [J 

It was essential for proving Theorem [2] that rj t = {h,ft) was defined via urns and magic 
marbles for t < t\. There are many ways to complete the proof of Theorem (TJ one is 
to notice that when the particles separate after the first meeting time r 1; we can do the 
whole coupling construction (that lead us to the proof of Theorem [5]) anew, starting from 
scratch. The only thing different will be the initial marble configuration for rj t = (l t , r t ), and 
the environments of l^ olya and rf olya , but only at finitely many sites, thus establishing the 
finiteness of the second meeting time r 2 . The finiteness of T3,T4, . . . follows by induction. 
□ 

This proof followed from the unusual coupling construction with the magic marbles and 
the domination by two RWREs, one on the right and one on the left. As we already men- 
tioned, the above domination can be constructed without using the magic marble approach, 
and generalized to work for more particles than two. However the approach taken in this pa- 
per allows us better understand the dynamics behind the two-point processes, and is valuable 
as an innovative coupling technique. 
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